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ABSTRACT 

The Refugee Education and Employment Program (REEP) 
of Arlington. Virginia, was designated in 1983 as one of seven sites 
for participation in a national Mainstream English Language Training 
(MELT) project of the Office of Refugee Resettlement. The primery 
project goel was to link overseas refugee camp training to refugee 
programs in the United Stetes to facilitate refugees* English 
language learning and transition to employment end independence in 
the United States. REEP was selected to field test and refine three 
products and components of the project, including: (1) field testing 
of three versions of the Basic English Skills Tests (BEST) designed 
to measure general language ability; (2) testing and refinement of 
standardized Student Performance Levels, general descriptions by 
level of students' language ability; and (3) elaboration and 
specification of a set of curriculum guidelines entitled the "CORE 
Curriculum Guide," to be used as a reference guide for the 
development of U. S. based curricula. REEP benefitted from these 
tasks in the improvement of its methods end in the testing and 
achievement of its own goals of promoting refugee self-confidence, 
employment, and independence in the United Stetes. (MSB) 



*********************************************************************** 

* Reproductions supplied by EDRS are the best that can be made * 

* from the original document. * 
*********************************************************************** 



o 

iRIC 



i 



TBS 9AIBSTBBAB BIG LI SB IAIGOAGB TB1XBIBG PBOJBCI 

by fin Biney 

Arlington Befugee Education and Eaployaent Program 

Arlington 9 A. 

in late 1983 the Office of Befugee Resettle nent 
awarded a grant to the Befugee Edacation and 
Eaployaent Brograa of Arlington to be one of seven 
sites nationwide to participate in its flainstreaa 
English language training Project. the priaary 
goal of the project was to link overseas canp 
training to refugee prograas in the U.S. in a way 
that would facilitate the refugees* English 
language learning and transition to eaployaent and 
independence in the O.S. 
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This paper will (1) briefly review the BELT 
project and RBEP's participation in its |2) preview 
and interpret* froa BEEP'S perspective, the three 
najor oetcoaes of BELT (the BEST Tests, the Student 
Performance Levels, and the COSE Curriculua Guide); 
and (3) point out soae of the influence and 
implications the project has had for BEEP and sight 
have for other refugee prograas. 



IBTBOB0CTX0B 

In late 1983 the Office of Befugee Besettleaent (OBB) 
funded the Befugee Bducation and Eaployaent Prograa (BEEP) 
to be one of seven sites nationwide to participate in a 
national desoastratioa project called the Bainstreaa English 
Language Training (BELT) project.* The award of a grant to 
BEEP was in part based on tbe fact that BEEP had already 
developed and was already using its own cospetency-based ESL 
curriculua (flansoor and Van Cuzer 1982). As stated in the 
Federal Begister, the overall goal of the BELT project was 
"to identify, eiaaine, and docunent certain criteria as they 
relate to the linkage of overseas ESI training and donestic 



*The other KELT sites were San Francisco Coasunity college 
District, San Diego Coaaonity College District, Spring 
Institute of International Studies of Denver, northwest 
Educational Cooperative of Illinois, project Persona cf 
Providence, International Institute of Boston. BBC Sesearch 
of Mew Uaipshire, the American Council fcr nationalities 
Service of Sew lorx, and the Center for Applied linguistics 
of iashington, D.C., were involved in the project's 
coordination, data collection, and training. 
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ELI prograas. These ace criteria pertaining to assessment 
and testing, student pec for nance levels, and EIT curriculua 
design" (Federal Begister 1961). BEEP interpreted this goal 
to aean linking refugee pec grass in the U.S. to overseas 
caap training is a way that will facilitate the refugees* 
learning of English and transition to eaplcyaent and 
independence in the 0-S. , and to provide Beans for 
docuaenting this process. 

Ibe HBLT Project was designed to address the special 
needs of a new ESi population, refugees, who first started 
entering the U.S. in large nuabers in 1975. This new 
population is guite different froa those student populations 
which aost existing ESI prcgraas in the U.S. have been 
designed for. First of all, a significant nuaber of 
refugees in EX»T prcgraas are aiddle-aged or cider and are 
seai- or non-literate in their own language. In addition, 
aany coae froa traditional and rural backgrounds very 
different froa urban North aaerican culture, flany arrive in 
our prograa in a state of disorientation because of the 
abrupt changes they have been through and are still going 
through. Furtfaeraore, in addition to having the above 
characteristics* none of which favors second language 
learning, the refugees are expected to learn English guickly 
and sufficiently well in crder to becone eaployed and 
independent taxpayers. 

The HEtT prcject Has planned in three phases which 
involved identifying what products needed to be developed* 
developing then, and field testing then. g brought 

together experienced ESI practioners froa both the U.S. and 
the refugee caapc overseas for the purpose cf consultation 
and developaent of curriculua guidelines and perforaance 
level descriptions. || developed three new field-test 

versions of the BEST lest, fhaje HI involved the selection 
and funding of prograas as "national deaenstration sites'* to 
help coaplete, field test, refine, and validate these new 
products. Because BELT was intended to be national in scope 
and broad is relevance, the sites which were selected varied 
in size, background, resources, expertise, and approach. 

BEEP was one of the sites selected to be involved in 
Phase III, the field testing and refining of the three 
products and components of the project, shown in Figure 1. 
This phase involved the field testing of three versions cf 
the "BEST lests" (Basic English Skills Tests), designed to 
aeasure students* general language ability. Secondly, Phase 
II involved the testing and refineaent of standardized 
"Student Perforaance Levels" (SPts) , which wculd be general 
descriptions, by level, of students* language ability, 
thirdly. Phase III involved elaborating and specifying a set 
of curriculua guidelines, the "COBE Curriculua Guide", whir*' 
would serve as a reference guide for the developaent of U.S. 
based curricula. 
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OVEBVIBB 

Before describing REL?*s three components in sore detail, 
and BEBP f s participation in the field testing of then, I 
«oo Id first like to present a plan and overview of the 
project and explain how it : components night he useful to 
refugee programs in the D.S.* In this overview, X will use 
onr site, BEEP, as the example BELT site. SEEP developed 
the plan shown in Pig ore 1 in Deceeber of last jear when 
BEEP first began the project. the assnnptions behind this 
overview helped guide BEEP v s input into the project 
throughout nuch of the year, as we worked on testing and 
refining each of BELT'S three conponents siaultaneouely. 

As shows in Pigure 1, refugee ESI students entering the 
U.S. fron the can pa would first be given one of the three * 
versions of the BEST lest. the students* scores on this 
test would serve as an indicator of their student 
perfornance level (SPL). BEEP would then use inconing BEST 
test scores and SPLs as the two principal criteria for 
placing a student into a SEEP instructional level. 

As we continue to follow Pigure 1, we see that BEEP has 
two tracks of instruction, "A" and "B". Track A would serve 
those students with fewer than six years of previous fornal 
education in any language land those who tend to be slower 
learners and in need of a nore basic curriculun and 
instruction). Track 6 would serve those who enter BEEP 
after having already had six cr sore years of education* Cn 
the basis of their previous education, students would be 
placed into Track A or Irack B. Then, on the basis of their 
BEST scores and SPLs, students would be placed into one of 
the instructional levels within each track. Flaceaent into 
BEEP # s instructional levels would be aade on the basis of 
the set of correspondences between BELT'S SPLs and BE£P*s 
instructional levels shown is Pigure 2. 

lhat would it aean to conplete an instructional level? 
In accordance with the reconaendations of the COSE 
Curriculun Guide (represented in the center of Pigure 1) , 
the BEEP Curricului would be comprised of various job and 
life skills, or "conpetencies". A student* s aastery of any 
competency at any instructicnal level would be specified and 
measured by perfornance objectives vhich the student would 
be expected to saster by the end of the instructional level. 



I should eaphasize that this is lerely one interpretation 
by BEEP of how the BELT Project night work for BEEP, and it 
does not necessarily reflect the views of the other MELT 
sites or OSB. 
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Certain of these performance objectives would be prioritized 
as "key" performance objectives. lbese Mould be considered 
the sost essential lifeskills for the purpose of evaluation 
of the students' completion of the level and readiness tc 
progress on to the neit higher instructional level. At each 
successive level, the perforsance objectives and the 
knowledge and language reguired to saster then would becoae 
sore difficult and couples. 

finally , as Figure 1 illustrates , when the students 
finish their instruction at BEEP, they would be given a 
different (but eguivalent) version of the EES! Test, this 
tine to deteraine their SPl aj£gr, instruction. This second 
perforsance level would serve as as indicator as to whether 
the students had sade progress la the prograa, how such that 
progress had been (and over how aany hours) , and what the 
students* job readiness would be in teras of general 
language ability. 



THE BEST TEST ABB MB SlODBBf PBBFOBBABCE LEVELS 

Cf the three components cf nElt, the BESI lest, developed 
by the Center for Applied linguistics, was the most finished 
product when Phase III began. A refinement of its 1982 BEST 
predecessor, the 1984 BEST is a competency-based ESI 
proficiency test which can be used for placement and 
diagnostic purposes. During Phase III, BEEP helped field 
test the BEST Test, pre-testing 125 students before 
instruction, and post-testing 103 after instruction. At the 
sane tine, BEEF, along with the ether REIT sites, helped 
evaluate and comaent on all aspects of the test, providing 
the center for Applied linguistics with valuable feedback 
for the purpose cf test refinement. 

The SPls are descriptions of students 4 general language 
proficiency in English regardless of previous language 
training. In this respect SPls are similar in purpose to 
ESI levels, though SPts are designed for a different type of 
student population and for lower levels of second language 
proficiency. BELT'S SPls are cospriseu of ten levels, the 
lower sii cf which are descriptive of students at SEEP and 
probably aost refugee programs. In addition to describing 
language ability in global teras, the SPls also describe 
ability by component or skill area (e.g., listening 
comprehension, oral coaprehension, reading and writing, 
pronunciation) 

Eefore field-testing the SEIs, BEEP and the other sites 
were first trained by the Center for Applied linguistics 
(using videotapes, of actual refugee ESI speakers) in 
identifying a given subject's SPL. Hbile BEEP (and the 
other BEIT sites) used the SPL descriptions, and assigned 
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thee to refugees, BEEP at tlie sa«e tiee aade suggestions for 
revisions of tie SPls with regard to their clarity, 
conciseness, and consistency. 

At BEEP, se found the EES! Tests and the SPls viafcle 
products which, if ased, would eguip sites to cosiaalcate 
with one another in the sane teres. 

IBB COBB COfiBICQtOfl GOIDE 

Of the three coaponeots of the IEL1 project, the COBB 
Curriculua Guide was the least cosplete at the beginning of 
Phase III, and throoghoot the past year it has been the 
coaponent shich has deaanded the greatest proportion of oar 
tiae at BEEP. 

At the beginning of cf Phase III, the COBE Guide 
consisted of scae geaeral corricolua considerations, an 
extensive list of coapetenciea and functions by topic, an 
inventory of graaaatical structures, and sose saaple 
currlculua foraats. Because the COBE Guide was still in a 
inconplete fore, our curriculea revision work vas 
necessarily a tao-way process. Bhile revising its own 
curriculua in accordance with the reccaaeadatioas of the 
COBB Guide, each of the seven sites was sisultaneously 
waking suggestions for how the COBE Guide itself sight be 
revised. Oae problea se experienced was that we had to 
define our own currlculos is teres of a COBB Guide which was 
itself not yet cospletely defined. Ihis two-way process, 
involving seven sites both Influencing and being influenced 
by the COSE Guide* is illustrated is Figure 3. 

Of the seven sites beginning the project, BEEP was oae of 
those which had already developed and was already using a 
curriculua which was sisilar is sasy respects to that which 
had been recossended during the first phase of the Bill 
project. For eiasple, HHP's 1982 curriculua was already 
coapetency based, it already included and indexed language 
functions and graaaatical structures, it already had a 
separate literacy track, and it was already organized into 
topics which were identified areas cf student need. 

Because BEEF had teguc the project with this 1982 
curriculua, we were able tc focus acre of our tiae on 
refining what already eiisted, rather than on inventing 
coapletely new iteas. In addition, we were able to 
incorporate into oar existing frasevork new ideas and 
considerations, recoaaended to us by the COBE Guide and the 
other sites. In response to the recoaaendatioss of COBE, 
for example, we shifted our curriculua aore toward 
developing refugee esployaect and independence. Also, in 
response to the recoaaendatiens cf CCBE, we have introduced 
a cross-cultural cosponent, a aaterials and techniques 
coapenent, and a reading and writing coaponent. 
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Further tore, though our discussions with the other Bill 
sites about the project, we tiere sti aula ted to research and 
consider lore caret ally the definitions and roles which 
coacetenci.es, per fcr nance objectives, language functions* 
and grassatical structures should have in our curriculum and 
la our classrooa instruction. Finally, in response to CBS's 
request that ve provide a seaas for neasureaeat and 
docuaentation of student prcgress (federal Beport 1981), ve 
developed aore specific per for nance objectives and aore 
refined achieveaent plans fcr aeasureaent and docunentation 
of our students* performance. 

In general, our continual work on field testing and 
revising the COSE Guide enlightened and facilitated the 
revisions of out ova curricula*, ie nay summarize BEEP'S 
revision of BEll*s competencies to illustrate this. One of 
our tasks as a BEll site vas to evaluate all the 
competencies in the COBE Guide. lo facilitate this BEll 
task ve developed the procedure represented in a flow chart 
fern in Figure 4- After coapleting our BEll task, ve vere 
able to turn around and use the saae procedure fcr the 
ref inesent of our oun curriculua. As shown in figure 4, ve 
first evaluated and rated a coapeteacy in terns of its 
content validity, i.e., its survival iapcrtance for our 
students. Ihen ve judged the appropriateness of its 
placement into the topic acd level to which it was assigned, 
finally, ve judged its fern, including its clarity, 
conciseness, and consistency of expression. 

COBC10SXOI 

Clearly, BEEf's aost valuable reward fron participating 
in this project was our owe education. throughout the past 
year, while we were constantly faced with deadlines and 
deliverables, ve were given a considerable aaoant of freedon 
to express and develop our cwn ideas. throughout our work, 
we ained at our original BEll goals of promoting refugee 
achieveaent of self-ccnf idence, employment, and 
independence in the U.S., and providing standardized and 
reliable means for documenting that achieveaent. 

How veil BEll will succeed nationwide will depend on bo* 
well refugee prograas throughout the country recognize the 
iapoxtance of REil's goals and the potential of fi£il*s three 
products. BELl*s valid aia for all cf us, whether we be in 
San Francisco or Kansas City or Arlington, is that we, as 
ESI professionals, all speak the saae language so that we 
will all understand each other and work together better. 
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ACBBOBlBSGBBBBfS 

this is a revised version of a presentation I did vita Peggy 
Seufert-Bosco, SESP's HEli lasting coordinator, at the 1984 
BAIESOL conference. I as especially grateful to Xnaas 
ftanscor, BBBF's BBI1 Project Director t for her saay helpful 
consents on this paper. 

TBI ABTBOB 

Sin Biney is Cocricnlns coordinator and Briter for the flELI 
Project at the Befngee Education and Snployaent Prograa in 
Arlington, Virginia. 
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ZS&ttl Blister . Volnse *B, Bo. 162, pp. 37723-27. 
Friday, August IS, 1983. 

Banaoor, Inaaa and Carol Van Dozer- 1982. 2ftS MIE 
CSIliSSi^l- Arlington Public Schools, Arlington, fA. 
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